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~- ABSTRACT 


liMeCnemimewmets eharacterized with regard to frequency 
Seolecuive fading and atmospheric noise under restrictive 
mathematical assumptions, and compared with measured 
Beet stiles. woucuuel channel characteristics are utilized To 
obtain parameters for choosing appropriate convolutional 
codes. Short threshold decodable convolutional codes with 
only a moderate amount Pf interleaving are shown to be 
People of afrfecting a reduction in the output error 
probability by at least an order of magnitude, for uncoded 


error probabilities on the order of 2x107°. 
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tee LNTRODUCTION 


Radio communication in the frequency range from 2-30 MHz 
has been common for many years. However, the reliability of 
such a channel is not high enough for modern high speed 
Bempuver to computer communications. in order to increase 
mm@emre liability of this form of communications, the nature 
eieone Channel must be understood, or at least modeled in 
peeashion that is a reasonable approximation to the situa- 
Pom. Once this 18 accomplished, various solutions may be 
Mememoted TO Obtain optimal reliability via the channel. 

Momdescripe ule Silvvabion in general terms, the trans- 
fete r Sends a Signal through the channel to a receiver. 
However, due to various causes, the signal received may not 
Bemume One sent, in which case an error is said to have 
occurred. These errors result from two basically different 
causes: 1) eel distortion, and 2) noise. Noise is 
Considered throughout this report to be completely unrelated 
meme srenal, while signal distortion is considered as a 
Petreurbablon Of the signal and thus is related to the 
Signal. As an example, if a portion of the signal energy 
mepdelayed so that it arrives slightly later than the rest 
of the signal, interference will result. If the interference 
momGesuricuive, the total received signal will be less and 
the signal is said to fade. 

The first section is devoted to a detailed discussion 


of the signal and one common form of noise associated with 


rat 





Miemenantcw, ime Second section discusses convolutional 
codes in general and applies them to the channel es charac- 
memmzcad in the first section. It is shown that it is 
possible to obtain several orders of magnitude imorovement 


mimeme Drobability of not making an error. 
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TI. THE SIGNAL ENVIRONMENT 


A. INTRODUCTION 

The HF channel is difficult to analyze in general due 
to the number and complexity of the various Datweme vers. 

The channel is time varying over a period of hours, days, 
Meavns, or years. (The eleven year sun spot cycle greatly 
effects parameters such as Maximum Usable Frequency (MUF), 
Lowest Useful Frequency (LUF) and absorption.) In general 
the HF communication channel is not normally line ey Sales = 
this implies that there is some form Cibomdmumne involved 
with the path of propagation of the electromagnetic radia- 
tion. This 'bending' results from two principal sources: 

1) refraction caused by a gradient in the dielectric 
constant of the medium, and 2) reflection caused by an 
abrupt discontinuity in the dielectric constant. Refraction 
normally eeounten ror 4 considerable amount of the signal 
energy received and, is commonly referred to as the specular 
component. 

In the way of a basic review, the upper atmosphere 
becomes ionized in various regions from ultraviolet and cor- 
puscular radiation from the sun Cilpeiner deny elecure— 
magnetic radiation is refracted by these eve lermeand s1 i) Une 
Cece ame or Carrier 1requency is properly chosen the 
radiated signal will return to earth at the Geceiver.w line 
amount of energy received is dependent on many factors 


ranging from antenna polarization to angle of launch or 


ee. 


ee 





Pee oe eemandstie €xXacy Stave Of the ionisphere. Frequently 
[miiplespavhs will be possible and the resulting signals 

eee ule receiver may add either constructively or destruc- 
aye Ln additvon Co the refraction, some of the incident 
radiation may be scattered from irregularities in the ionis- 
emo Cmuiiao Well also be received. Figures 2.1 and 2.2 
illustrate the basic phenomena. Hence the received signal 
iemeone Sum of the scatter and spectral signals. The 
meooabillity characteristics of this type of signal have been 


well treated by Nesenbergs [2] and are included here only 


for a review. 





: Receiver 
iieansmitter —= 


Pit ow wie oource Of specular components. 
Paths which result in the reception of two 
specular components at the receiver. The 
refraction of the incident electromagnetic 
energy is a result of the gradient of ion 
density as a function of height. 
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Irregularities 


in Ionisphere 





Transmitter 3 


~~» 


Pisce mcnemmoOurce Of the Scatter Com— | SS 


ponents. The scatter components 
WeSstilietrom Lhe weflection from 
iladhvemiGeweateave by abrupt discontinuities 
Mimricmenocpmere, ne Giscontinuities 
may be due to numerous causes such as 
meteor trails or turbulance. 


Receiver 


Mor a fiven path length, a relatively straight forward 
computational procedure may be followed to give the maximum 
usable frequency, and the relative amplitude of other 
specular Bite which may be presented with the fraction 
of time these components may be expected. Hence, i Oe ecm ee eels 
operating frequency, a rough approximation may be made with 
regard to the number of specular components. This, we shall 
own wmortech ume biG error probability. Table 1 is a 
set of sample predictions (from Ref. 2) indicating the 
specular components probable together with the percentage 
Ol times they were expected to be present. 

It is apparent that this system is quite complicated, 
so let us begin by making some restrictive assumptions which 


will facilitate the mathematics. 
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MomaesMilewuiaueviae HF “channel under consideration is 
SIaerOnarye | While this 1S nov strictly true, over the 
period of several minutes it is a very reasonable approxi- 
mation. A second helpful assumption is that all the 
components (scatter and specular) are mutually statistically 
independent. This assumption will permit us to use char- 
acteristic functions and simplify our task. (The number of 
modes possible may be det.ermined by the relationship of the 
carrier frequency with the maximum usable frequency, however, 
if the modes exist their effects may be statistically 
independent. ) 

aver emoesaasumed Im this section that the environ- 
mental noise is gaussian. In a later section we will con- 
pecemeate some derail 4 recent model for atmospheric noise 


and indicate the modifications which resultT. 


B, so.GNAL AMPLITUDE CHARACTERISTICS 

We begin by considering the received signal as two 
dimensional, where the two dimensions will be the inphase 
and quadrature components of the signal. We will have 
SceatmeneveGnconscider two basic types of signals which may 
be present at the same time, hence we define a signal to 
Pemoweculocat at is of fixed amplitude, although the phase 
iia cieeinbestandem.. A Second type of signal, called 
scatter, is characterized by a symmetric bivariate gaussian 
distribution which for mathematical convenience has equal 
inphase and quadrature variance. We define the probability 


distribution function (DF) of the random variable X as 





ACS) = ites) (OCs .@) AE) Ke Oe 2 Ge 
with the corresponding probability density function (pdf) 


dF (x) 


f(x) = AG : 


Meewiil be convenient to define, in the standard fashion, 


the characteristic function 


ee E [ed °*| 


=~ sf eJ&% dF (x) 


nO 


co 


i ed &X fexe Gl 


—_— 


where E[:] denotes the expected value. 
For our purpose, we consider the two dimensional case where 
M@pvgmeaweron( kes x, Y < y) 


Piece cOrresponading joint probability density function 


iMm@xey) and Characteristic function 
c(Esn) = Jf oJ SEXINY) p(x yy axay . (1) 


Poaeeoconholder a typical specular component, 


elomare X. Poo mecOc ite —component , v. the sine component, 
lV, | is the envelope and ¢ the phase of V,. Let us assume 
that the phase is uniformly distributed over (0,27), and 


independent of [Vv | - Since we are dealing with a specular 
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@enponeny, which, by definition, has a constant amplitude, 


we have 
Vee 3 \ 


where e and Y; are the inphase and quadrature components 


; - a 2 
respectively and r. = Xs cE Yq 


_ 
and since LV, | and $, are independent 


iv] 49,6029) = fyy, [P24 6 


We desire the pdf of Vi > which may be expressed as 


IEE 


Conc ecodt— is f.. (x.y) dxdy 
ve IVI.¢ xy “a 
tiemeinmeg variables to x = pcoso?, y = osind, we have the 
Jacobian 
lel 


so we now have 


te at gfe.) dodo = 7 pf. (pcos, opsind) doedd 
p ? il 


from whence 


Pia] 62%? = ay Pe0+ osind) 


i 


ef, ORB) 
i 


and 


ee eo f ey? | (2) 
V; 5 | Vv | 


OT! x+y 


yest 





From equation 1 we may write the characteristic function 
for the specular component as 


a a qd (Extny) Ae ry] dxdy 


oe: Za xo +y* 


C, (En) 


Again letting x pcosd, y = epsing; the Jacobian is again 


0 and 


os Je (Ecosotnsing) s(5_r) 


Ce = ‘ dod 
,(65n) ie fe |o|dpd¢ 
The exponent may be reduced by noting: 

Ecosd + nsind = Bera & cos¢ t+ ene See 


J EP ane v Ef 4ne 


J 2242 cos(¢+a) 


BECos@. 


where © = (ee an? cn) ieocainelmi norm on (0,27), hence, 


CO 


ian Papces vr 
C,(E,n) = Cee eae Sear anc do'dp 
0 0 


From Reference 3, item 9.1l.el 


J 6%) = a eJ C089 55 (ne)ae 
hence 
Oe r 6(m-r,) J9(tp)dp (3) 
7 I,(Er,). 


pea 





where fT = [22452 : 


items webicwaeemlt ton tO one of the Sie@aever. COMpOnentus, 
which is characterized by the bivariate gaussian distribu- 


tion, we have the pdf: 








xe 2 
_ 5 os oe 
1 Ome Gaye 
- i ile 
fg (x,y) = —-——— e 
i vy, 2 
eno. 
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_ 20% 
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os i ais 
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where again p = Ve a 


Mone heterence 3, atem 26.1.26 the characteristic function 


Ss 


C, (¢) = e (5) 
a 
Were again t = ee , 


We now define the scatter vector to be the sum of all 
the independent scatter components. Our motive for proced- 
ing to the characteristic functions becomes clear since the 
characteristic function of a sum of independent random 
TOs omoanciy shies product of their characteristic Trunc- 
PuOMe whence, we have for the characteristic function of 


Miemscatlver component: 


os 





oO. C 
n pearl oa 
C2) aaa lye 
i=] 
n 
ae e ig 
- aia (6) 
=e 
Roan 
- L 
=e 
n 
where of = Fs Carn iMieomeniamacteriavile function of this 
i=1 


scatter vector and one specular component is then 
C(c) = C(t) C,(o) 


gore 


e J (Gr, ) 
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PmeeoooGune a tOveal Of n specular components the character- 


istic function becomes: 


1@| 
CC : Gay I) 


im@emecilaracveristic function, as we have developed it here, 


is convenient for expressing only the even moments since 


2 ae i 
ee hee |) CC) 


iiemce conc moment (m = 1) is: 


5 n 
Homes =o +t) 4 


ait 





The pdf for |V| may be expressed in terms of the Humbert 


hypergeometric series (see Ref. 2): 


2 2 
02 


i 
Al 
ee) ee (8) 
0 0 


Pry 6? = = Ceres = 
O 
Let us now restrict ourselves to digital systems where 
we may relate the signal pdf above, to the probability of 
eamerror 6, We define the probability of an error as the 
expected value, averaged over the distribution of the 
signal amplitude, of a "probability of error function." 


In other words 


WD 


= EIp.(o)] 


cS) 


tl 


f pele) fy) (ede 


ie oaovaet Livy eOh error Tunetion’ is determined by the 
modulation/detection procedure and the noise environment. 
It represents the probability CMolaaweean error al a par= 
te cular time as a function of the signal amplitude and a 
given type of noise. Equivalently, it may be viewed as 
Pacer mene probeastlity of a false alarm or the probability 
Of a miss in detection theory. We consider only the case 
of noncoherent frequency-shift-keying in stationary, zero 
mean, gaussian noise. If the signal duration is Te the 
receiver bandwidth B, and the total noise power is the 
receiver pass band is No? then the probability of making an 


error for a given signal amplitude is given by Montgomery 


[4] as: 


BS 





O 

T Bo 

2Ng 
p, (0) = 4 e ; (10) 


Wemnmove, im passing, that in case of constant signal energy 
where p = VE, our definition of the probability of an error 


meamcONnsistent; since in this case, 


ace) ee ei 


and 
T.Bo* 
©0 — ONG 
gB=f ke 5(p9 - VE) dp 
0 
ms 
ON 
= ke 0 


Tome 1s the well known result, giving the bit error prob- 
AeilacGy as 2 fumection of signal energy/noise energy. 


Vittiepnecrstemal duration, T receiver bandwidth, B, 


a ? 
aac nolse power Noy» we may utilize equations 9 and 10 
together with the envelope pdf given in equation 8 to 
PepeMomunceDropebpiiiuty of an error, The result, from 


Nesenbergs [Ref. 2], is 


N aa we 
_ 0. Hl : : 1 n 
B= mp STON, Yo [ts2-2e--- 223 Tae aN, | 
Ss eee 0 of + 0 soe 0 
sims eB iy ae 
S S S 
where ie alice pace wom. tiie ee specular component and 
2 


o© variance of the scatter components of the received signal. 
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Nesenbergs has developed bounds for this hypergeometric 


series in Reference 2 which yield: 





r ae 

EEE a 2 
Bee 20 ToBr 2 
5 Aen = 5 Do. | + 2D 
Bo T BCr’+to~ ) T BCr’+to") 
S S S 
1 + N sane a a 
O O 0 


where ene Figure 2.3 is a plot of some special cases 


calculated by Nesenbergs’ in Ref. 2. 

It can be seen from Table I that as the frequency is 
Gecreased below the MUF, other propagation paths may occur, 
Paoreepime in the bit error probability as described in 
BRquation 11. While for frequencies well below the MUF, the 
Signal amplitude pdf may be very nearly Rayleigh, for 
frequencies near the MUF the Rayleigh approximation is not 
Beopropriave. One could reasonably expect the ratio of the 
operating frequency to the MUF will be roughly related to 
mime Crror Drebability., Inereasing the ratio toward 
Mules meses in fewer modes with a corresponding decrease 
in the error probability, while a decrease in the ratio 
indicates the possible existance of more modes causing an 
increase in the error probability. This effect is experienced 
Gitemenper!1ods Of the day, such as sunrise or sunset, when 
HiewiUMetrs= changing rapidly, and the carrier frequency is 
fixed. Tsai [5] and McManamon [6] have also noted this 


FTicchmame more quantitative terms. 
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Peeeeme oe rat error probability 6 as a function 
Gimewenal tO noise ratio (db). (Reprinted 
from Ref. 2, p. 82, with permission.) 
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Mime maireemOuncoUrse,Ouner SOUrces Of error in the HF 
channel. One such source, which may have an appreciable 
mele Gcmmon bie crrom probability, is atmospheric noise. The 


next section deals with this noise in some detail. 


te) 2 MOSPHERIC NOISE 
ioe ide roauicw .oOn 

Atmospheric noise is the name generally associated 
with electromagnetic energy which has its source in natural 
phenomena such as lightning discharges. In general, atmos- 
pheric noise is impulsive and nonstationary. Geographically, 
meemereorresue aynemic range occurs within the tropics, from 
whence it propagates into the northern and southern hemis- 
pmeres, For any particular location the received rms or 
average power will be determined by local thunderstorm 
activity, as well as the propagation conditions to 
the tropics. Although the largest dynamic range (on the 
order of 100 db) occurs in the lower portion ofthe frequency 
spectrum (ELF-LF), it may be the limiting type of noise 
(eviaecdemayOr portion Of the HF spectrum. Statistical 
parameters such as average power, and average envelope 
voltage have been measured quite accurately and the results 
published in the form of Technical Notes by the National 
Bureau of Standards, and the International Radio Consulta- 
tive Committee (CCIR Report 322, "World Distribution and 


Hiieseuct sures Of tbmoOsphneric Radio Noise"[7]). 
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Numerous models for atmospheric noise are contained in 
the current literature [Refs. 8 and 9]. Most of these models 
Peewliasead On an Impulse model with the impulses distributed 
Becording to some particular rule. Models such as these 
Mevesowo principal difficulties, first the parameters of 
the distribution are chosen so they match the first order 
statistics of the received noise and have very little 
foere hayplOon with Statistics such as pulse interval distri- 
Dimeton Or pulse duration distribution. Secondly, there 
may be serious computational difficulties. A more recent 
model was proposed by H. M. Hall [Ref. 10]. The Hall model 
feoitionbOo Lit the measured statistics of the noise and hence 
will be used for the remainder of this section. 

2. The Hall Model 

The noise y(t) is considered to be the product of a 
zero mean narrow bandpass gaussian process n(t) with a 
covariance function io ee and a slowly varying regime pro- 
cess A(t) which is assumed to be independent of n(t) and 
mecmlonary.  nlvuhough the actual atmospheric noise is non- 
stationary, it may be approximated by a stationary process 
Peummcmreasomanly short period of time. The statistics of 
the modulating regime process are chosen so the resulting 
produetpey(G) = A(t) - n(t), jis an accurate description of 
the received noise. 

Summarizing Hall's treatment we have the following pdf 


for the regime process 
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f(a) = k —— 
a ee 


(a chi distribution with parameters m and o), where k is 


chosen so that 
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The use of a finite limit for the amplitude is based on the 
Perea comversence Ol the integral for 1 < m < 2, since 
mpemeneresy radiavead must be finite, and to match the observed 
levels at the higher frequencies in the HF band. 


The gaussian component is 





O 
fi(n)2—bie “nm (14) 


O10 
n 


ipemealcullation of the pdf for y(t) is straight forward 
[Ref. 11] 
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Noting that the integrand is an even function and making the 
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In order to compare this mathematical model with the 
measured atmospheric noise we must find the complement of 


ene probability distribution function for the envelope and 


phase. We let 
cr V(t )Cos(w t + o). 


The pdaf of the envelope and phase may then be obtained in 
terms of the inphase and quadrature components of the 


received noise as 
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where ie Can) is the joint pdf of the inphase (y) and 
quadrature (y) component of the received noise. Changing 
wertables on the right hand side of the equality sign to 
y = VCos@, y = VSingd, yields the Jacobian, J = V(Cos<¢ +f 
Sin< 4) = V and 


I Me (V,o)ddav = SS V ff. ~(V cosd, V sind) dvd 
vo ‘2? vo V3 
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hence 


oe Ayo = V i a cosdé, V sind) 
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We let n(t) represent the quadrature component of the narrow 
band gaussian noise and y(t) = A(t)n(t) and y(t) = A(t)n(t) 
where crn) = it (Uo) = N[O,R (0)], and n(t) is independent 


of n(t). We may now express the joint pdf as: 
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The complement of the desired distribution function is simply 
the probability that the noise envelope voltage exceeds some 


ame shold, V ie. 
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For convenience we define 


P(V) = Vee) 
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Figure 2.4 is a plot of the envelope level (in db above y) 
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vs. -log,,|1n P(V,)| for various values of m. Figure 2.5 


and 2.6 are plots of actual measured atmospheric noise at 
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Piuinvewo he De obtained from the Hall model 
for various values of m 
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Heeure 2.5. APD of atmospheric noise measured at Laramie, 
Weems 502350 MST SI6OPEB 1970, at a frequency of 2.5 
MHz, A indicates measured values, the dashed line 
is obtained from the Hall model with m= 3. 
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Figure 2.6. APD of atmospheric noise measured at Laramie, 
ivewmeeso5-co43 Msi 17 PEB 1970, at a frequency of 
5.0 MHz. A indicates measured values, the dashed 
line is obtained from the Hall model with m= 4. 
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frequencies of 2.5 MHz and 5.0 MHz respectively.” A plot 
aero Ormeeoteiteure is an amplitude probability distribu- 
tion (APD) and represents the percentage of time a given 
Mevele's exceeded as a function of the level. The plotting 
Zee Ss ecesened SO that thermal, or gaussian noise plots 
as a straight line with slope -%. Montgomery, in 1953, [4] 
Showed that, for FM or PSK modulation systems, the probabil- 
Zeemote Geeiriror 15 One half the probability that the 
noise amplitude exceeds the signal amplitude. Hence if the 
signal-to-noise ratio is 10 db, one has simply to find the 
Memeetivate Of time the level corresponding to 10 db above the 
rms noise level is exceeded. This percentage will then be 
twice the bit error probability. As anaside, an approximation 
womune SPD may be inferred from the data in CCIR Report 322 [7]. 
As in the case of the signal amplitude, we have only 
fowammed am ‘average' bit error probability. There is no 
iigmcoulOomwwOle tiie, correlation between errors. Present 
research (Spaulding, Disney, and Espeland [12]) indicates 
Paare tne DUrSt Interval distribution and were Guration 
distribution may be matched as closely as desired by proper 
pe oecllelearplvonmer bhe Covariance function for the modulating 
regime process A(t). While this is an important factor, it 
is not within the intent of the present paper, so we will 
Siiiply five some typical cases to indicate the character- 
wowile-Metmerhes burst parameters. Figures 2.7 and 2.8 are 
*The data presented here was obtained at Laramie, Wyoming 
during the period 16-18 Feb., 1970 while the author was in 


guest worker status with the Environmental Science Services 
POMS pea e1ON), 
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cee rises DUration Distribution of Measured 
atmospheric noise. Recorded on 4 April 1969 
petweemeooO0eand C400 Mest at Boulder, Colorado 
dueequemey es MZ, 
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huetre 2.6. Pulse interval distribution of atmospheric 
noise. Recorded on 4 April, 1969 between 0000 and 
O400 MST at Boulder, Colorado on a frequency of 
5 MHz. | 
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Mees sol tne pulse duration distribution and pulse interval 
distribution respectively, for atmospheric noise at 5.0 MEz. 
For completeness, the APD for this set of samples is also 
meegebed as Figure 2.9. 

Since the median signal energy to noise energy ratio is 
nominally greater than 20 db for the HF channel, we will 
use this figure to obtain estimates of the effect of the 
atmospheric noise on the channel. It may be seen from 
meeure 2.9 that @ 20 db signal to noise ratio will corres- 
Mememrourhly tO a bit error probability approximately 
5 x107° ielompaetiites 2c. 7 sndlicaces that for the pulse 
duration distribution only 7% of the pulses were greater 
than .6 msec in duration. (The 20 db signal to noise ratio 
corresponds to level 5.) A similar analysis of Figure 2.8 
indicates that 55% of the intervals between bursts were 
longer than 60 msec. For many HF circuits, particularaly 
where a large signal to noise ratio exists, the atmospheric 


Meomsemliioroauces essentially random errors. 


Dee tiODELING THE HF CHANNEL 

The preceding sections developed a relation between the 
bit error probabilities and the number of multipaths in 
eeuroraneceretween the transmitter and receiver. The behavior 
observed is not new or unexpected; it has long been known 
tiaGeasstew as Six equal amplitude signals of random phase 
fem emeouiinead te five 2 distribution which is nearly Rayleigh. 
We must, however, bear in mind the assumptions utilized to 


arrive at the results obtained: recall that we assumed 
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Figure 2.9. APD of atmospheric noise measured at. Boulder, 
Coller2g0)0000— C400 MST, 4 April 1969, at a fre- 
amemey or 5.0 MHZ. 
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Svavionary and statistically independent specular and 
scatter components. It should be mentioned that some of 
The multipath conditions may result from magneto-ionic 

reo tane® and may De correlated. In addition we did not 
discuss the time delay (which may be as much as several 
milliseconds) nor the frequency distortion or doppler. In 
general we are dealing with a channel where there is corre- 
lation between errors, and even groups of errors. In 
Pmepracal terms the bit error probability may be expressed 
as a function of time as in Fig. 2.10. Time periods, when the error 
probability is relatively high, could well result from the 
Peemsuance Of multiple propagation paths, while the periods 
eiesomall error probability are most likely due to little or 


no multipath and only atmospheric noise corrupting the signal. 
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Figure 2,10. Error Probability as a Function of Time. 
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Another factor which limits the use of the channel is 
the differential time delay incurred by the signal traveling 
different paths. This time delay places a lower limit on 
the signal duration (for pulsed systems) since, if the 
signal duration is about equal to the time delay over one 
Sieeae propagation paths, it will be received during the 
eoeduens Stfenal tame frame. This differential time delay 
ieeeemeene Order of 5 msec and hence a lower limit on the 
Signal duration is between 5 and 10 msec. To make more 
Saidetent Use Of the allocated channel bandwidth, the normal 
Mesecodure 15 teeirequency multiplex several channels onto a 
Semmonm carrier and Wtilize a signal duration of about 10 msec 
on each of the sub-channels. Again propagation anomilities 
pu@weeas tie doppler shift may cause ‘cross talk’ between 
Pemocenumemeannetls.,. This, in many instances, results in 
frequency selective fading where the fading is confined to 
eesmall section of the transmitted bandwidth. 

imerderere describe the channel in qualitative terms 
we need to know how the errors occur. The simple bit error 
Mmeeoaotliay 15 nov SurTrficient. 

If the message is to be transmitted as binary digits 
Suitably modulating a radio frequency carrier, then a burst 
of length N is defined as a sequence of N digits beginning 
Tithe in error that is immediately preceded by a correct 
Pececiceengdine wath an error which is followed by a correct 
bit. The burst interval is defined as the interval between 


iow emia inc with the first: correct digit following a 





burst and ends with the last correct digit preceding the 
next burst. A gap of length m is defined to be a sequence 
of m consecutive error free digits between two successive 
Peers. A Sap May occur within a burst or actually be the 
mest interval. 

It is apparent that the sequence of received digits may 
Memecomoletely punctuated by the errors into bursts and burst 
meer vVals, however this partitioning is not unique. The 
Meese lengeth and Durst interval distributions are statistics 
fee oe Channel and must either be known or at least a 
Peo enavlewsbatisbical estimate should be available. Since 
MiemearoluiOnaneg 15 not unique, the burst and burst interval 
=memla nob be used CTO characterize the channel. To avoid 
Peomcrirciivy, we return to the gap distribution. While 
moemeap Giseribution will affect the burst length, it is 
not subject to interpretation ambiguities and may be used 
to uniquely determine a possible channel model. 

There are two primary methods of characterizing the HF 
aide Iie wtirse Consists of actually recording error 
patterns and statistics for a reasonably extensive period 
of time and assuming these are representative of the channel. 
The data may then be utilized to determine the effectiveness 
of various coding schemes by actual simulation or the 
performance estimated by the coding parameters. The second 
approach is to use, again, measured parameters to infer a 
stationary homogenous Markov chain model which may then be 


Weilized to characterize the channel. The usefulness of 
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Poets Method follows from the properties of the stationary, 
memopeneous Markov chain, since the chain is completely 
eharacterized by the matrix of one step probability transi- 
Mees. his approach is presented in detail by Fritchman 
[13], Tsai [5], and McManamon [6], together with results 
which are in very good agreement with measured data. The 
Peemerodic Markov Chain model, as described by McManamon, is 
completely determined by the gap distribution. Since a gap 
mmeleneth nis, by definition, a sequence of n consecutive 
error free digits which are immediately preceded and followed 
by errors, the probability of a gap of length n, f(n) may be 
meeerprected as the return to an error state in exactly ntl 
steps. Therefore, f(n) is simply the first return probabil- 
mot stribution of the Markov chain. The mean return time 


may then be expressed as 


mee) 
ib 


i = 
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me stationary distribution of the Markov chain is of con- 
siderable practical importance. Denoting the probability 
Gaeeerhe Output of the channel at time j is in error by P(Jj), 
we may then ask 'How does P(j) behave as time progresses? ! 
The answer is given by the Ergodic Theorem for Markov chains 
(Cox and Miller [14]), where the stationary distribution is 

wT tlncdsam,verms of the mean return time. The standard 
Fetinitvone for the first return in the Markov chain includes 
miemreuuraestate. Therefore, in terms of the gap distribu- 


tion f(n), as defined above, 
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where 8 is the average bit error probability. This simply 
states that after a long period of time the average prob- 
Beer ty OL the Output being in error is independent of the 
initial distribution and is equal to the inverse of the 
average gap distribution. 

In summary, the HF channel is neither the classical 
fmeaecom error channel nor the typical burst channel, but 
rather a hybrid channel which may contain may contain many 
Pome sbUrsts between which occur random errors. For the 
convenience of the reader, the measured burst and burst 
imwerval distributions given by Tsai [5] are reproduced 
here as Figures 2.11 and 2.12 respectively. 

Figure 2.ll may be ied VeMmebmcmnie vie DUrss Guravion, 
for example 80 percent of the bursts are less than 20 bits 
in duration. Figure 2.12 gives the interval between bursts, 
PaGmoy aA similar examination it can be seen that 40 percent 


of the burst intervals were less than 1200 bits. 
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er CODING 


A. INTRODUCTION 

In the preceding chapter the effect of the channel on 
mieomeransmicted information was described. It should be 
noted that the modulation/detection procedure assumed is 
non-coherent frequency-shift-keying. This assumption was 
made since it is in wide use and of Ponee ee amae Dea Crea 
mmporvance. 

Before we discuss specific coding procedures let us first 
Paeerowe tm a very basic Manner, what we want to do, and what 
Peeeroole.,) A discrete, or digital communication system 
iieewateh the performance may be described by error rates and 
Meepenltliities 1s assumed. The first question that comes to 
mena is “Is there some ‘source’ which we could utilize in 
mecmenannel LO Obtain the maximum rate, R, of communication 
with the sinus Ie ore rate?'", The answer is yes; for a 


meommitcane Class Of Channels, Shannon has shown that a non- 


@emoscapacity, C, exists such that 


C = max R 
[source ] 


Math an arbitrarily low error rate. In general it is not 
possible to engineer a system to the point where R = C, and 
maemo rooabllity of an error is extremely small. We choose 
to modify the question and ask "For some rate R (< C), can 
fromolewuiemeaniiy reduce the probability of an error?". In 


other words we are not really trying to solve the 


lho 





"Optimum" problem but rather a problem of what is 
measOonable. 

If we assume for the moment that we have a return 
channel, we have available simple error detection tech- 
niques, such as ARQ (Automatic Repeat Request) and the 
parity check schemes. The ARQ systems, introduced by 
Van Durren, are frequently referred to as 3-out-of-/7, or 
"constant ratio codes," where the encoded messages consist 
feeeeved Dits in which three ‘ones’ and four 'Zeros' are 
required to form a valid code word. Any single error, 
edcwerrors of odd multiplicity (3,5, and 7), will be 
detected while only half of the even errors will be 
detected. The remaining even errors will then constitute 
Meco’ errors at the output. 

In the parity check system a sequence of n-1l information 
carrying digits are appended by a single digit, known as the 
Berity check digit, so that the total number of ones in the 
mn sequence is even. Again at the receiver, the parity is 
checked and if this check fails, an error has been detected. 
It is again apparent that this scheme will detect all errors 
MemoecemuUltiplicaty. The efficiency is much higher being | 
aoe, however, the rate again suffers by the retransmission. 

(Mother ralterniavive, Which is more attractive, is a 
system where error correction is possible. In general, the 
Eemec@omcecudne code waich will correct ‘t' errors, con- 


Sj omermaemapeing of k information digits into n channel 


meme onehmasthashion that at least 2t + 1 channel errors 
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will be required to change any valid transmitted word into 
another valid word. The decoding may be done in many ways. 
One, becoming more promising as the state of the art 
develops, is by a table look-up from a read-only-memory. 
In this procedure the received word is compared with the 
valid code words and the one which differs in the fewest 
positions is then chosen as the most likely one to have 
fem sent, 

In the above paragraphs we tacitly assumed that any set 
of n channel digits were determined by a unique set of k 
information digits, and conversely one set of k information 
meee s Uniquely determined one set of n channel digits; 
mies corresponds to block coding. Another form of coding 
Meraeos any Set of k information digits to affect several 
Moeks Of Channel digits, and conversely any block of channel 
digits will be affected by several blocks of information 


Miletes: this corresponds to convolutional (or recurrent) 


Seoqing. 
If the yh sequence of n channel digits contains the 
corresponding aoe sequence of information bits explicitly, 


the code is said to be systematic. Systematic codes may 

have a marked advantage over non-systematic codes in that 
they may, of course, be decoded with error correction by 
those with the decoding equipment, while those with only a 
limited amount of equipment may, with proper synchronization, 
simply regenerate the code from the appropriate information 


imp oeeancmise the result for error detection alone, relying 





Meme wedieamisatom Lo correct the indicated errors. Those 
Maemiave l1tple Equipment may, for the price of timing, 
have access to the information digits alone. 

In summarizing the above procedures, we must again look 
at the channel. If the operational requirements are such 
mgt a tCWO Way, or return circuit is not possible (for 
example in a fleet broadcast network) the error correction 


Capability is highly desired. 


Eee CONVOLUTIONAL CODES 

Let us begin by describing a few items which are very 
Mmeeeen>Oo tne discussion which follows. The term encoding 
mamceo LO 1moly a transformation or mapping from the set 
of information sequences into another set of channel 
meammemees, aS Lijustrated in Figure 3.1. The code is the 


image of the transformation. 






Possible Eneoder Possible 
iat ormatvion Channel 
sequences Sequemecs 


fepoume 35 iL. Mapping PpeoOvieed by code. 
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We restrict our attention to binary codes, where the ele- 
ments of the information and channel sequences are either 
weeeor l, If cach input sub-—bliock contains a digits, while 
the corresponding channel sub-block contains y digits, the 
code is said to be a rate 7 code and designated as a 

"(y,a) code." Since we are dealing with binary codes, the 


addition we will use is Modulo 2, where 


Cen be tL 


0 


and 


A convolutional code is said to have memory svan v, if 
each encoded digit is a linear combination of information 
meerts in the present set, and at most v -— 1 of the preced- 
meemese ts Of information Gigits. It should be noted in 
mesotet. that if v = 1, the code corresponds to a block code. 

Another parameter, Wiwehmpcmeclosely related to the 
Memory span, is the actual constraint length (N), which is. 
femineda for a convolutional code of memory span Vv, as 
a vee lhas constraint length plays a role in convolutional 
wodes camilar to the block length in block codes. 

Pomwmeowmollcl1onal codes, we Gefine tay as the ag Gane dee 
oa. the ae set of channel digits, in terms of message digits 
m, (1); as 


re oy . Ga os (22) 
t E, 5 (ndm,_,i) i SY 


(Modulo 2) 
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th 


where Ms __(n) owt he | Gibeat ot the Gece set of infor- 


Meactaon Gigits, and By 46m) is either 0, or 1 depending on 
whether or not m;__(n) is to be included in the ae trans— 
Mitcted digit. From equation 22, we can see that any partic- 
ular message digit can affect at most v sets of y transmitted 
oeetes, which prompts the definition of memory span. 

Turning our attention to the elements E, 46m), the 


choice of values for these elements will clearly determine 


the properties of the code. If we define Eq ;(n) as: 
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maye= i) 50 


50,5 esa 
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0 ie ee 0 
a.3 Ss q # 


where oF i_—Zoromisi fee. and | if j = k. The first a 
3 


@ieits of the i’ set of channel digits will then be 


identical with the a digits of the i°" set of information 
“ers. in whieh case the code is said to be systematic 
(or canonic systematic). In most of the following we will 
treat systematic codes only, since Massey [15] has shown 
that any EE stintic code can be converted to an equiv- 
alent systematic code without affecting the error correcting 
capability of the code. In general the constraint length of 
the non-systematic code will beshorter than that for the 
equivalent systematic code. 

MP iiompolmitea shor> example might help to further 
Seolaiietmae Procedures. 


Pxoplcmie rf cystematic (3,1) convolutional code with 


Meneryesvan 5. From equation 22 we have 
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are! .(n)m, . 2 
=) g=0 n=1 ecg ee 


Since the desired code has a = 1, we let m;__{1) 5 Mae. and 
fein) = & ., We may rewrite equation El-1 as 
QJ QsJ 
v-1 
ts ——o.. £ -M. 4: 
J g=q aed i-a 
Now, since the memory span v = 5, we have v - 1 = 4 and: 


z Ae 


Meee o.g 2) 1,9™1-1 * ®2,3™1-2 * &3,5™i-3 * 84 ,g3™i-4- 
Since the code is systematic, we know 


G01 = 1; and Eq 41 = 0. 


Meureus choose, somewhat arbitrarily, 


EQ > 0 Cai 


and 


B90 ,3 


The code now may be written as 


eel = vel 
ee ey ea. eel 
ba =m. + Ms _5 


noerethier code the actual constraint length is N = yv = 3x5 = 15. 
[Ginter ent method Of visualizing this encoding procedure 
was developed by Wyner and Ash [16], and consists in consicer- 


ing Bq jb droess 98 jee to be a row vector as 
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and My Hg a column vector of the (i4-q)%P set of information 


meeics such that 


= ah 
ie = [m,_, (1) Ms __ (2) Ms _ go) 3 : 
Then 
v-1 
ts _ = Jae im 
oJ q=0 God q 
If we now let Tt; be the column vector of the ge set Of 
transmitted digits, we have 
i cee STU On| |: tv ea 
eae oe Se SG alleen eee 
T. = : ' 
il 


G naan 
i as yi Osyny 1 


By dealing only with systematic codes we may greatly simp- 
ipeny the: - matrix i Cry = Or, and a(n) = 0 stor 
y e Paaceince Ey 3! ) fn Ba! ) 


q # 0 for j between 1 and a. 


Miememnetamthe (axa) identity matrix, 0 is the (a,a) null 


matrix and G. memmene. (y—-a) x @ Matrix defined as 





O 5 o+1 By ,0t1't? 85 a4 6?) Es at) 
Ge at? Bs g+26)) Bs gto 6?) a eee” 
G. = : = : hy 
“) ° ‘ (2 ) 
G5 oy Tie ey ey? 


If the number of input message sequences is indefinitely 
Mone, we may consider the transmitted channel digits to form 


a semi-infinite column vector T. Where T 


1 I 0 0 M, 
Cn rn. Mo 
., @ 2 0 M, 
cree My 
r= |v, | - 0 0 ee es Conon 
G5 G3 Gn Gy Go g b g g g 
. 0 ~ 0 0 0 0 I 0 0 0 O}|M_, 
coe ean ee Go So Go a M 
0 Oo 0 COM 0 Oo 0) |e 
vel arc mace MCC ANC MeCN} lec 
Y v-1 “y-2 aah 0 
. Cp OMEG OmEO nO 1 0) “Olihee 
oa ce) cans ° 
ee (25) 


miceoeacee(y—a)xa null matrix. For convenience we will 
memereterthe semi-infinite matrix which multiplies the 


column vector of message digits as G,, while the matrix 





meen generates only the ue sev Of channel digits may be 


defined from equation 23 as 


eae ee (26) 


peeemourh G has an infinite number of rows and columns, any 
particular row will have at most av non-zero elements and, 
Seerespondingly, any particular column will have at most 

N = yv non-zero elements. 


hove steomexampile 1, from equation 23 we may write 


the ie transmitted sequence as 
CCC Oe Win) im: \ 
L_=— 
ieee OP? Aim. 
7 1-3 
CO Oia M4 _» 
ie 
= m. 
Hi 


and by inspection, equations 25 and 26 yield 


Om On Om Om 
Ce—s e050 1 1 


CeOm nO at 
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Figure 3.2. 


100000000 
100000000 
100000000 
010000000 
110000000 
010000000 
001000000 
011000000 
011000000 
GOK OKO6NO) 
000100000 
001100000 
010100000 
000010000 
OOOO 
001010000 
000001000 
CAE OOOO 
COOTOLOO0 
000000100 
001001100 
000010100 


The physical generation of this code is straight forward 
involving unit delay elements (shift registers) and modulo 
2 adders (exclusive 'OR' gates), as shown in Figure 3.2. 
The rectangular boxes represent unit delay elements, while 


the circles with the cross Pepteccmu vune module 2 adders. 
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Returning to the general problem, when the channel 
digits are transmitted through the channel, noise may 
corrupt some of them, causing the received digits to Ga f ens 
meaomecne Original transmitted digits. Utilizing matrix 


notation, the ae received sequence may be expressed as: 


al “eal al 
2 ieee ee 
iam | eee eh aoc 4, (27) 
r ei e 
1s; avs 1; 


Where ey j fi wehowoane error has occurred in the fue position 
3 


of the ae transmitted sequence and zero otherwise. Our 


task may simply be stated as determining wnich element of 
Es are most likely to be non-Zero. 
Since we are dealing with systematic codes, we have 
D0 


available estimates of the i SSE oOteimrcormation digits , 


namely m! = Sy tvislazine che ie v - 1 preceding 


: Te ane 
1’sJ sd 
sets, we may regenerate the code with a duplicate encoder 


and obtain an estimate of the transmitted parity digits as: 


v-l a 
ae =), re ie Oct le ae 
13J 3 k=l God oC rere 
Byeaddanemuto. bo r, . (atl < 3 < vy) we obtain what is 
1;J oe aa =o 


ea ited be syndrome Ss 5 
3 


A) 





ees alee ere) 
o 

ae.) y (k) (m,_ +e, 

ee G ea ad 


v-l a 
+ > - k m+ ey. 
g=0 k=l Eq 5' 1-q,k 15J 


since : ~ 


v-l a 


toe OD k 
a q= @) a ae Bq 3 Ds abe Clay 


pimee the encoder is linear we may further reduce this 


syndrome to 


v-l a 
oe yi (k) (m + m. ) 
135J q=0 k=1 eas 9K se Clee 
v-l a 
ste y (k) e. +e, , 
a=0 k=1 ade i-q,k 15J 
however, m., TM. iO ee OGe 2. 
10) 6s Ole 
Therefore 
v-l1 
S. . : 5 k)e. Tec t Or a + 1 = Vey 


(28) 
For each set of y received digits we will be able to form 
¥ —- &® Syndromes, which depend only on the errors in the 
meee i Vvedeuscquchnce . 
 Oeieret ois —eOhnsider the Matrax notation and form a 
column matrix of syndromes. From equation 28 we may form 


os. as 
ale 





es 


Sa at? | eal 
: S, E 
eS ar le) |e i-v+2 
Sr 3 o4 9S.p 0 eas 06, 0 Gy 1 | (29) 
S49 ar 


Where 0 is a(y-a)x(y-a) null matrix, G, omen d Wed wigmequas 
tion 24, and I is an (y-a)x(y-a) identity matrix. We are 
now able to write the entire set of syndromes, S, in a 
Fashion similar to equation 25. 


vac © Uviniais 


G p 


9 = oo 1 
S5 Gy 0 G I 9g 0 By 
53 G, 0 Gy 0 Gyo L 9 0 3 
S = 
Syd ce Su . . oT : a? - ool 
Sy W) 0 Gioia te (0 G, 0 G, 0 Go LIE, 
es 
F oo 
or 


C. THRESHOLD DECODING 

With these syndromes available, we turn our attention to 
Weecmleoteeceoding Orifinally introduced by Massey [15] 
called Threshold Decoding, in which the error decoding 


decision is based on the value of the majority of the 
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syndromes corresponding to those Ware would: bere! i) sat, 
es 3 were actually in error. From equation 30 we see the 
first set of syndromes affected by EB. (i.e. the sul set 
Sieerror digits) is S.. Since the memory span is v, we 


few the effects of errors in Bs will have to be confined 


to the syndromes Ss = Seayey? hence: 





Where as before Gy 4s a (y-a)xa matrix whose elements are 


meer © or 1, i.e. the nae column of Gy is 


een” 
Bx oto 6d) 


Ex ot+3'd? 


e 


E, y (I) 


Thus those syndromes, which Mould pemamrectea by Une error 


ma The Fr pecttton Ol uneserror sequence Be will be those 


syndromes for which g, ,(j) = 1; Come 3 nS lS jtv-1). 
> 


In other words, if e. 5 = 1] and no other errorsoccur, only 
> 
those syndromes which have @, ees = 1] will be non-zero. 
3 
The presence of other errors within the sets of v - l error 


sequence either prior to, or aruer Bs may alter some of 





these syndromes to negate the effect of the error. The 
decoding proceeds by examining those syndromes which cor- 
responds to es j and a 'majority vote! decides on the value 


> 


of es Ac i.e., if more than half of the syndromes are 1 
3 


ime, decision is that Cig = 1 and the corresponding infor- 
lreon Gigit is changed. If the digit is corrected the 
effect of the error may be removed from the set of syndromes 
meeiverring all of those syndromes used in the calculation. 
This mode of operation is referred to as feedback 
decoding, and as long as no decoding error is made, the 
decoder operation is superior to decoding without feedback 
(normally called definite decoding). On the other hand, 
Pee ec CecoOdime (error 15 Made, the eroneous correction 
mands vO propasacve. Phis error propagation is one of the 
acknowledged difficulties of convolutional codes. To avoid 
error propagation we introduce the concept of a self- 
orthogonal (or canonic self-orthogonal) code due to Robinson 
and Bernstein [17]. A self-orthogonal code is a convolu- 
tional code in which any two syndromes which check Cig have 
Pale mole weIvOreGae1t ian common. oince all the syndromes 
which check Cs oj have ei i in common, the definition eee 
eWvmeoumielrEwerror Gigitesto, be included in at most one syndrome. 
Reopen oles shown thabmesselfi—-orthogonal code has 
Iaiepecmeiltei prepastatcrton., and on the other hand, may be 


decoded without feedback with no error propagation with only 


aoe tteloss iteerror Correction capability. 


6 


temmlluUStrtateme tes uiresiold Gecoding procedures, recall 


example 1, where 


By comparison with equation 26 we have 


0° Lis % = La) 2° La}s &3 = [ols om > Lo] 


feein equation 11 the syndromes which check the i°" aigit 


May be seen from: 


fen 
\e 
NO 


a5 
i+1,2 
i+1,3 
ee 
{+2 ,3 
1+3,2 
ata ae 
i+4 ,2 
i+4 ,3 





CO Cay Cama Ca Cae a= C2 
| 

Se ee eS ee 

Oe) Ae] oO oe em FO 


OV ewe 8a Oa SO mS LL 


and we see e. will effect the syndromes s. aoe : 
sleet alee alee 


: : “ee : ts 
oer >> eno eo. and eee Vio ieiive=synaromes, the major 
i miovomcce OCs Pee [IneaeenGeenly ai three or more of 

> 
these syndromes are 1. If this set of five syndromes is 


See emi evetiionwot une C€rror digits, it can be seen 


that the only digit in common between any two is C5 4> Hone. 





this code is self-orthogonal. The decoder is illustrated 
in Figure 3.3 where as before, the rectangular boxes are 
delay elements and the circles are modulo 2 adders. 
Returning to the general concept of threshold decoding, 
it should be pointed out that the encoder and decoder are 
relatively simple to implement. To obtain the maximum 
benefit from threshold decoding, the code should be self- 
orthogonal. Robinson and Bernstein [17] have developed a 
Meethesis procedure, utilizing finite difference sets 
whereby these self-orthogonal codes may be constructed. 


Som tei OUP atuention to systematic codes of rate one 


iteeeeecne transmitted digits assume the form 


1s = m. 


alice caer 
v-1 
Cee 


een Matrix notation 


0 0 


ei Se 





After the digits have been transmitted and received, we may 
again form the syndromes, realizing for this case we will 
have only one syndrome for each set of transmitted digits. 


Forming the que syndrome by analogy with equation 29 
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Bae eo 0 E02 Oe sr Ey 0 Eq | efayel 


ey 2 


ail 
fea 
‘ieee 
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oO DOD OM 
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We note that only the information error digits are included 
in the joe Piemenemcaleulaveon xcepu for the parity error 


digit e, 


Foe hence for convenience we will isolate the 
5 


meeermiarion and parity error digits and write instead 


A 
a aes 
ee oom ay 4,1) |°i-v41,2 
en Se eee I yy 0.1] |°4-y+2 2 
c= = . +}, 
1 
eee sy =2 £0) |S y-1,1! |Pi+v-1,2 





Where Sy ismearcolunmt Mavrix of the syndromes SpoceeoSgayiy: 


From the definition of memory span, the moe message digit 


Pool eouneccumunese Syndromes. Examining the we column 


feenicwmmauri x, 1% 15 Obvious that Ce, 4 Witt eatiecs only 
5 


those syndromes for which Es areal 


For threshold decoding we examine only those syndromes 


Heme whieh the su COluiMmenm ty cenrarns @. = 1, and form a 


J 
reduced set of syndromes 
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By stipulating the code to be self-orthogonal, we are assured 
that no column (other than the a) will contain more than 
one element. 

iimeiereuarena toval-ot L syndromes which check er 


then the majority logic decides e. = 1, if and only if the 


dieeel 
number of non-zero syndromes is greater than [#1 + 1, where 
(st is the integer part of o. A relatively straight forward 
calculation shows there are 2(L-1) prevrously decoded error 
Pecitions, =(L-1) error positions which have not yet been 


waeeoced, bk parity error positions, and e, which will 


dieealee 

effect the decoding, for a total of if Tol DOSslolLe poOstu1ons 
for errors to occur. If definite decoding (i.e. no feedback 
correction to the syndromes) is used, we may calculate the 
probability of making a decoding error for the binary 
symmetric channel (where the probability of making an error 
is 8 independent of the original value of the transmitted 
ola gang 

ipeworobpability Of correctly decoding es 1 is simply the 
eRmobaei lity that (St CGeeWweteeerOrs Occur in the possible 


te ~ 1) positions, hence 





deere decoding) — 


rr cy 





L°+1 


2 
slab tt oa g [n° ie 


i= (ST+1 


L°+1-4 


Z 
i 
a Peaen 











Pm@emune probability Chat a bit is decoded in error is Pop 





eae F (correct decoding) 
EZ 
L +] 2 2 
cs +1-4 
= 2 "7/6" Gea) a 
i= (S341 


If g is reasonably small this may be approximated by the 


first term as 


2 I, I, 
[Let | ttt 225 (3441) 
2m o B (1-8) , 


(33) 
\ ar 


itewaeCocdinie error probability for feedback decoding, 
Cneene other nana. Homreomemcdeeri1 cul, tO analyze. The bit 
MidewNcomstactrauion will be decoded correctly if 1 previous- 
ty decoded bits were in error, provided that fewer than 
(st Rector omoccimuanerme DOitcs which have not yet been 


fecodednama the L syndrome error positions. Hence the 


Prov tyy thay a bat 1S decoded correctly is 


(ST 


Picorrect decoding) 


Lite 
ees 


0  (undecoded Sigeors |< 2 - ifi 


decoding errors)*P’, decoding errors) 


eo 


LO 





For the conditional probability there are #(L+1) total 
mieeceoded Error positions, hence, assuming independent 


errors, 


(undecoded errors < : =e 1 deecocing errors ) 





e 


(Et-4 /L(L+1) meee) 
eee) 
| | gJ (1-8) (35) 


JO 
Designating the probability of a decoding error as Pan Ciene 


feedback decoding) and assuming again independent errors 


within the 3(L-1) previously decoded positions, 


a = enh esl 
P = 2 eG Se a 
(i decoding errors) 5 FD FD 
(36) 
tmeretore , 
[3 ee) L(La1) _, 
2 5 2 
p ; = By (1-8) 
(correct decoding) wan 20 ; 
@aesl) L(L-1) _, 
2 pt (eP) ate 
: FD FD 
it 
Noeine that 1 - Genes decoding) = Pan? bits May wor 


reduced To 


(ey ea L(Lt1) iGEM Nel L~1 ) 

7 es oe ee, omens. D il 
y BY’ (1-8) P 
= J 


1 Ce 
a ie 


oo Pa. (37) 
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Peeneueh rauner tedious, by hand, the solution may be 
Setvainea readily on a computer. Obvious approximations may 


femmieaae., when § 1S sufficiently small so that P ec 


pp << 
Pap < Ppp ew eeeas onal approximation is obtained by 
assuming Pen imeem cOlving the quadratic equation which 


results. 


Pees OTHER DECODING METHODS 
1. Sequential Decoding 

MiGiic@ealeorichinetor decoding convolutional codes 
#8 sequential decoding, which was introduced by Wozencraft 
Megeeewena Gdiftters from threshold decoding in that it is 
probabilistic in nature. The encoder for a (y,a) code is 
viewed as a directed graph or tree composed of nodes and 
branches. For a binary (y,a) code, from each node De 
Pmemenes emanate, and to each branch is assigned a sequence 
of y binary digits. The decoder has available or is able 
Mamorbewbhabte tle channel probability characteristics, and 
a copy of the tree which the encoder is utilizing. When 
the first few sequences are received the decoder proceeds 
to hypothesize which sequences were ‘most probably' sent 
and moves one node farther into the tree. This process 
Ome smumMia ll eCrrorceoccurm, at which time the decoder may 
get off onto the wrong branch. When this occurs it is 
Pomeoompormaxe G2dditional errors, since the sequences on 
Vimimeetirwce path have no relagion to the sequences 


actually transmitted. The decoder will eventually realize 


fe. 





Ghat something 1S wrong, at which time it back-tracks to a 
peeviously visited node and tries another branch. If none 
Seepaese Oranches are better, it again has to back-track to 
yet another previous node and search the branches eminating 
imeomechay node. All of these operations take time, in 
eddition to the time required to calculate the channel prob- 
Moet y Characteristics, when this must be done. If there 
js Only a finite amount of buffer storage available for 
Eaeominmcoming data, a long search might not be completed 
before the storage registers are filled, in which case a 
Peete Overflow occurs and the system must be resynchronized. 

sequential decoding may be done on any convolutional 
fede wand, if “the constraint length is very, very long, the 
decoder will eventually decode the transmitted sequences 
Cemwceerly with probabrfity approaching 1. 

Legeilivctragion purposes Consider a simple (3,1) 
Systematic convolutional code of memory span 3. Figure 3.4 
is the tree graph of the desired code. 

At each node are two branches corresponding to the two 
meee olemvoalues Of the amtormavion digit (i.e. 0 or 1), a 
DOeiiiplies the upper branch while a '1' implies the Towers 
Dain nts COoaqe Was comsurucued Dy utilizing the proce- 
dures developed by Lin and Lyne [20]. 

Iiiemiakest input subeplock (in this case a single digit) 
determines which of two output sub-blocks will be trans- 
time ommime ww. | > Lil; @ > 9000." The second output sequence 


will depend on both the first and second input sequences. 
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Figure 3.4. Tree graph at 
foro Micwonal code. 


If the first input was 'l' and the second COU Linen Ne 
second output sequence would be 001. The third output 
Seawence, in a like fashion, will depend on the first 

two inputs and the third mpl Lone LOuUrth output sequence 
is dependent on the fourth input and the preceding two 
inputs - and so the process continues. As an, example the 
imput sequence 10110 would be mapped into 111 001 100 110 
Oll. The encoder for this code may be implemented with 
unit delay elements and modulo 2 adders as indicated in 
Ieee 5.0. 

In the decoding procedure, the receiver pees Wie mea tee 
sets of sequences, then outputs the best estimate of the 
first digit. For example, assume the transmitted sequence 
Ta eee 2Ol lil corresponding to an meee ee Ll 


while the received sequences were ioanmool On 110 Oll. 


7 Vy 








Lace 
Hei - ms 
eb C2 
eC 2 
[eeoeemo ss) Gare sncojer £Or convolutional tree 


code shown in Figure 3.4 


The decoder ‘knows! that the first sequence was either 
lll or QOQO, between these two 000 is the more likely 
(assuming a memoryless binary symmetric channel where one 
error is more likely than two). 

Therefore, the initial hypothesis is that the first 
divgit of the transmitted sequence is '0', the decoder then 
Mrecececds FO the next node, again the two choices are 
O00, and lll, of these 000 is again the most logical since 
Meeyeolc CrLrOr ts required to transform O00 into OOl. 
Going on to the third node the decoder chooses lll again 
TieMnone Crror. 9ft this point the total number of errors 
required to transform the transmitted sequence into the 
received sequence is three. The decoder calculates at 
Fie oOla as au the other nodes) the set of channel 
puovdbiimtuy characteristics and decides that perhaps three 
errors in the nine digits is excessive in which case it 


ieg@eamopmchcwotacer Dranches from the third node. The other 


iS 


branch is quickly ruled out since four errors would be 
indicated. The decoder then goes back to the second node 
and looks at the other branch, where again the number of 
pigeots wWOUlG be three, so the decoder continues back to 
the first node. Again the first node lower branch indi- 
cates two errors, however, the decoder goes along this 
path to the second node, where the upper branch has no 
mmtemicaved errors. Going farther into the tree to the 
third node there are again no additional errors hence, 
the decoder alters its initial hypothesis and assumes the 
Mascot to be '1'. Proceding into the fourth node there 
Smee 1neicavea errors within the constraint length, so 
the decoder hypothesis is the second digit is '0O'. And 
so the process continues, backtracking when the number of 
of errors becomes excessive. 
eo, Viterbi Decoding Scheme 

Another method of decoding convolutional codes is 
Wem ©verotealeorithm [2i}. Omura [22] has shown that this 
decoding scheme may be viewed as a forward dynamic program- 
(miteoollG@ien to a generalized regulator problem. The state 
Sembmesemcoder au tame k+l is dependent on the state at 
time k and the pus message input, hence one may write for 


the state at time ktl 


Ms ye TP M, 


The OULpUL Of the encoder at time k is some function of the 


state of the encoder at time k, hence the output may be 





denoted as i = G(X). Again transmitting the encoder 
output through the channel, the received sequence will be 


ae = eet Ey Defining a performance measure J(T) as 


L 
TOpmooce(R|T) = —- &£ logP(R,jT,) 
7 Keay Kk 
k=0 
the decoding proceeds by defining intermediate costs as 


if (Xx 


L 
L-k =min —- {2 logP(R,|T;) 


L-1(j=k+1 
J WS 


re 


for each k = 0,1,...,L-1, and defining f(x, ) Oo ce 
the decoder follows the path with the minimum COStL anne l on 
will occur if and only if the minimum cost or tiaecumrred On 


some path other than the correct path. 


E, APPLICATION OF CODING TO CHANNEL 

The maximum expected differential time delay of 5 msec 
feerrd1 frerent propagation paths requires the signal to have 
a duration of about 10 msec, which in turn implies a maximum 
data rate of about 100 bits per second. For convenience, we 
shall assume that the data rate to be Heecdeas (5 bits sper 
second, which corresponds to the standard 100 word per minute 
teletype. In addition, we shall use a rate % code, and, 
since the encoder outputs two digits for each input digit, 
the modulation method will be frequency Gewese invde 1— 
plexing the information digits onto one 75 bit per second 


subchannel and the parity digits onto another. A block 


diagram for the system is given in Figure Bao 
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The distributions given by Tsai [5] were obtained 
Merlizing a channel data rate of 75 bits per second, and 
maewmcate tLhat with probability 0.97, the bursts are less 
Pieme 50 bits in duration. While it is not impossible to 
implement a burst error correcting code to decode bursts 
Of length 50, the burst correcting codes all require a 
minimum guard space of error free digits. This error free 
Pememspace 15 not generally found in the HF channel. 

pie e MUrs lt correcting codes are not desirable, the 
PmicectmallvVe 1S to modify the distribution of the bursts. 
This burst modification may be performed by a process 
known as interleaving. Interleaving is simply a time 
ordering of the transmitted digits so that adjacent errors 
in the channel are spread out in the received sequence 
prior to decoding. (Some forms of interleaving may be 
viewed as time multiplexing.) Interleaving by k bits may 
be accomplished by many methods, however, one of the 
simplest We to replace each delay element in both the 
emeocer ana decoder by a k bit shift register. This has 
the effect of inserting k columns of zeros between the 
SrMMinemiiecme Seneravor matrix, G., of the code, and 
correspondingly k rows of zeros between each of the rows 
Diechces,yndreme Matrix, A. Any burst of errors that is k 
CUbeamelee shorter in length wiil not affect more than one 
of the digits in each of k succeeding decoding steps. On 


the other hand, there may be errors from more than one 


oe 


burst included in the decoding calculation. The inter- 
ieeavine Cannot alter the average bait error probability, 
fee COeS 1S rearrange the errors so they occur in a 
more evenly distributed fashion. For the data presented 
Pyetsai, interleaving by 50 bits would then insure that 
mem pian two error digits from a particular burst would 
Same olvermmed in the digits utilized for any decoding 
@eemaylon with probability 0.97. 

The amount of interleaving required is dependent on 
MZi—m—illranrom ana rrequency of the bursts, and the constraint 
Pieeh and correction capabilities of the code being used. 
As the amount of interleaving is increased the channel will 
Peo eemore and more random, however, it must be noted that 
miecmmneer Leaved data willl be extremely susceptible to 
Memrodlc intverierence unless care is used in choosing the 
interleaving. (For example 64 bit interleaving would not 
bemdesirable for use with a modulator utilizing 32 sub- 
Paine se siamese OCcecastOnal modulator synchronization errors 
would be related to the interleaving. This would have a 
much more serious effect on the proper decoding than if the 
interleaving were chosen to be 63 or 65 bits.) | 

When attempting to ascertain the degree of interleaving 
Po@ired, actual Channel eharacteristics or measured error 
Dabvterns are utilized. For a given set of received digits, 
varying amounts of interleaving may be tried to determine 
when the errors are "random enough." To determine what 


"random enough" implies, consider a set of data for which 





the average bit error probability is 8. If the constraint 
mepevi Ot themweode is Nvafdd the code is interleaved by I 
bats, then the effective constraint length will be N‘iI, and 
the decoding will be performed by Be teins this effectiv> 
eonstraint length. Although the total number of errors is 
still the same, the ratio of the number of errors per block 
approaches 8, since, by the law of large numbers, the 
Peepability of having more than 8 NI errors in NI digits 
approaches zero as NI increases indefinitely. In general 
this would imply an excessively large amount of interleaving, 
Since the trend may be rather slow. 

Another criterion iS available to determine a reasonable 
estimate for the amount of interleaving. For any given 
code, the ratio of the number of errors correctable to the 
number of possible error positions may be obtained. For 


the definite decoding procedure of the preceding section 
LST 





this is s Wetnemdcscoday bla tunertilon properly (Cor at 
Ie 
least with some improvement) until the ratio of the number 


of errors to the number of possible error positions reaches 


L 
[st 


L°+1 


Migeccmleso unas che Patio of the number of blocks of 
a 
O 

Lo+1 

of blocks is approximately equal to the probability of a 





Hence to determine a practical interleaving degree, 


length NI with more than 





lieemieers., to the total number 


decoding error for a completely random channel with 
the error probability 8. For convenience we will use the 


jeiimivemaecoding error probability Pop: The term 





approximately above is used loosely since the effectiveness 
of the interleaving is extremely sensitive to the actual 
Beists received. 

To ililustrate the procedure, consider a particular code 
Capable of correcting two errors, with constraint length 18 


as given by: 


oe COO 00000 Lim, 
te i-8 
T, = |t, 5| = {100010110} |m, _, 


iirerlcaving by IT bits will simply insert I columns of Zeros 
between each of the columns of the generator matrix above, 


and replace m. The reduced set of syndromes on 


ek 2) Sie 
Which the threshold decoding is based are: 


by 


35 aS 100010110000000 ere) al “(Gein 2 
Sn Zz S (4427) ee OO OOOO OOO) | . i eae 
S (4447) UC TOCOrerTO000 © (444) ,2 
S (4487) OCCOte OT OCegO1 1 coal ©(44+81) ,2 





acne Tt). 1 


Again I rows of zeros are to be inserted between each of the 
rows of the multiplying matrix above. For this code there 
are a total of 17 possible error positions within which 2 


errors may be corrected hence the ratio of correctable errors 


oD 





Bomboual error positions is 7 Rwom equavion 33. the de= 


soars Error probability, Pps may be approximated as 


es g3(1-p)1" 


Ppp (8) =|"3 


I2 


6 808° 


We now turn our attention to the actual error data, as 
contained in reference 23. We will consider three typical 
cases of measured error statistics where the average error 


e 


mebewp 1S about 2.5xl10 -. This implies that P Salou 


DD 
5x107>. iiverleavinewby i — 27 bits results in the number 
of blocks with more than a Glove) requalwco 95>out of 2 
total of 63675 blocks for a Pe idual uncorrectable error 
leave of 1.5x107>, Interleaving by 54 bits lowers this to 
about 1.2x107>, while interleaving by 104 bits only brings 
it down to eo crOw, Continuing to increase the inter- 
leaving to the point where I = 855 only changes the residual 
error rate to cr ee thuseis presented in tabulation 
megimrelarive to NI in Table TJ7. Again it should be 
mentioned that the effectiveness of the interleaving is 
strongly dependent on the actual characteristics of the 
bursts. (This information is not available for the data 
presented.) It appears as though a conservative amount of 
incverleaving would be 54 bits for the code under considera- 


tion, since for this value, the code would correct many of 


the channel errors, and still be reasonably practical. 
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Although the code presented here is not a very powerful 
one, as compared with some of the block codes or longer 
eee olutional codes, the ratio of correctable errors to 
total possible errors is nearly as good as the Golay block 
Pifemewwhiich 1s capable of correcting 3 errors - (a5 as 
compared with st) - immaccurien the Simple syndrome 
decoding procedure is flexible enough so that by moma bol rng 
the syndrome register, the mode of decoding (definite, or 
feedback) could be determined - choosing feedback decoding 
during periods when there are relatively few errors indi- 
cated in the syndrome register and switching to Ae beak 
@ecoeding when the number of indicated errors could amply 
possible error propagation. This VOMlGeel ve va nipiver Cul— 
put error probability during definite decoding, however 
there would be no error propagation. 

For the feedback decoding, and reasonably small 8B, 

Pap is at least as small as Pop: and we assume 2 or 
From equation 35 
3 
P(channel errors<1]1 decoding error) 1 -{73}] 8° (1-B)7=1-558 +998 
E 


P(channel errors < 2|0 decoding errors)=1-['3 p> =1- 1658° 


P(channel errors=0|2 decoding Pe eiea) 11825585 -1058 


@ncetrom equation 36: 


; ia 6 a a 
P(O decoding errors) = (1-Ppp) = 6Pan + 15P ap 

_ ca - 2 
P(1 decoding error) = 6PEp(1-PEp) = 6P an 30P an 


P(2 decoding errors) = hen 


Q4 





Substituting these expressions into equation 38 and solving 


Mmm@emresulting Quadratic equation yields 


_ _14+3308°-15848? 83) 36 


3 2 
30(-118+1658 -5188 ~ 


12 
FD (14+3308°-15848~)* 


By expanding the square root and retaining only Pet dies © 


myomcterms (Since the third term involves fe fe. becomes 


_ {a+3308°-158us3 _\/, ,{, _ 1658°x30(-1n8+1 652" +5288") 
PD \ 30(-118+1658°-5188~) (1+3308°-15848>)° 


The minus sign is to be used, since the positive sign results 
in a probability greater than 1 for small values Ole ess and 


Pap may be simplified to 


1658 


Pp yh 


FD 14.3308 


Peecomoariscon of the decoding error probabilities is given 


Mamelable Il. 





TABLE II 
ee ee ee 
B Ppp Pap 
107° 680x107" 1.65x107" 
107° Basie cone 1.65x107' 
107" Aaa ee 


Ea EEE 


Tt must be noted that these calculations are for a com- 


pletely random channel, however by interleaving by 54 or 
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more bits they should be within an order of magnitude of 
the observed statistics, again depending to a large extent 
weenie actual distribution of errors. 

The discussion of effectiveness of coding must include 
Bome mention of block coding performance. One of the better 
block codes is the modified Golay [24, 12] code, which will 
correct 3 errors within any 24 bit code word. For reasonably 
small 8 the probability of a decoding error Pac is approx- 


imately given as 


— foul og 
coe (7) 


1062684 


2 


Mmewerror probability Page omer sad ueciicOr probability, 
Paiaeetiie probability for a 24 bit word, or equivalently a 
immed intfermation word. To be comparable with the bit 
Eimeer probability obtained for the convolutional code, this 
word error probability Wopeoemeonvervedslo a bit error 
mm@mabality (Ret. 23). Hor the degrees of interleaving 
Meized for the convolutional code these bit error prob- 
fomiuuies are listed in Table Jil. 

As can be seen from Table III, the codes are essentially 
comparable with the Golay code being slightly superior in 
performance, while the convolutional code may be simpler to 
implement in hardware. 

The implementation of the code is straight forward, the 


encoder is shown in Figure 3.7 and the decoder in Figure 3.®. 
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AD es eer 


Peco Ah tse) OF birt ERRORSPROBABILITIES FOR 
CONVOLUTIONAL CODE AND MODIFIED GOLAY CODE, 


CHANNEL ERROR PROBABILITY, IS APPROXIMATELY 2x107° 
Decoded Bit Decoded Bit 

NI Bieter tirouaba li vy MiicOl roma ttt y 

Convolutional Code Modified Golay Code 
480 ie come 5 3x10" 
960 ieee 3. 4x107- 
eo 786x107" 2.3x1074 
15360 59x07" 1.1x1074 


In this case, each rectangular box represents a 54 stage 
shift register. The mode selector examines the general 
E@owen Ol vhe syndrome shift registers and if there are 
numerous indicated errors the mode is changed from feed- 
baek decoding to definite decoding, the decoder remains 
mieeide Gdetinite decoding mode until such time as there are 
relatively few indicated errors when the decoder is returned 


to the feedback mode. 


F, CONCLUSIONS 

The improvement of the reliability of the HF communica- 
Gion channel through the use of error correction coding has 
Poomipgienmajor concern of this thesis. The average bit 
error probability is determined by the number and duration 
Simiie@es and atmospheric noise. The fading is assumed To 


bemeonematerference phenomena resulting from the existence 





Paolo te propazavion paths, and lasting for periods of 
approximately one second. The atmospheric noise contributes 
fmegcaeom errors CO the normally burst characteristics produced 
Mmeeeche fades, 

It is demonstrated that simple convolutional codes 
utilized with moderate amounts of interleaving can obtain 
me@oroximacvely an order of magnitude reduction in the output 
Meee rror probability. In addition, the relatively simple 
Seecedimnes Scheme may be modified during reception to elimin- 
meememne POSSiIbDIity of error propagation, with only a 
Poet vely manor Loss in the error correction capability of 
the code, 

iimowder FO Tully wlilizge the channel other procedures 
spmeula be TOllowed, namely space diversity, where two or 
more separate receivers are utilized with antennas in 
physically different locations. This decreases the effect 
Peete tresultang trom the multipath conditions since 
Bnew tadine at different locations is generally uncorrelated. 
In addition, frequency diversity (when possible) should be 
employed, since the fades are unrelated for carrier frequen- 
cles separated by more than 50 KHz. 

mices phe normal alvVocated bandwidth in the HF spectrum 
Meo kiZ so Meamy Separate eee may be freauency division 
multiplexed onto the same carrier to achieve a higher data 
havemon the Channel. Existing frequency division multiplex 
equipments have a 32 channel capability, with the sub- 
Cremmeleneach Operating at a 75 bit per second rate for a 


maximum data rate of 2400 bits per second. The error 


Ore) 





werereoecvlGn COGiINng will require a sacrifice in the data rate 
Semeeme citannel tO provide a reduction in the output error 
Pore >y Using a rate =~ code the information rate through - 
the channel will be reduced to 1200 bits per second, 16 
swecoalimels may then be used for the information bits ard 
eeewremaining 16 subchannels for the parity bits. One 
method of implementing such a system indicated in Figure 


Bio 


G. RECOMMENDATIONS FOR FUTURE RESEARCH 

There are three primary areas where considerable research 
could be applied: these are 1) the characterization of the 
HF channel, 2) the modeling of man-made noise and inter- 
ference, and 3) the decoding of convolutional codes. 

im the characterization of the HF channel the use of the 
eon chwalim model 15 most promising, however, the principal 
pemecewor Girficulty is the non-availability of data. The 
data analyzed has been obtained from actual channel measure- 
ments which may have been perturbed by categroically diffrent 
propagation conditions. To avoid these interpretations, it 
mmc ceoMmnenaed unat EXIStTing Tonospheric channel simulators 
(24) be used to obtain characteristics which are dependent 
only on multipath phenomena. Actual channel data could then 
emecomoarcad with that from the simulator To Wemomiiinice © ole 
coumee omen spercuUrbation. 

In the area of impulsive man-made noise or signal inter- 


m 


ference maximum use could be made of the Hall model. The 
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Hall model was discussed in this thesis only for the ampli- 
tude characteristics of atmospheric noise. However, its 
principal advantage lies in the ReacCmepnaums lard s ll es Such 
as pulse interval and pulse aiutcamuonemave be correc. Ly 
obtained by proper specification of the PONoetaace 1 LNeCULON 
of the modulating process, A(t), as described on page Zon 
This would be a valuable tool in the design of receivers 
for use in areas where unavoidable noise sources (such as 
powerline transients) cause excesSive error rates with 
conventional receivers. 

One of the most important fields for additional research 
5s in the area of decoding algorithms for convolutional codes. 
In general, there are some codes with desirable distance 
parameters, but good Cenercalsdeceding algorithms are not 
available. Threshold decoding, while relatively easy to 
Minokement, is nov applicable to all codes. Sequential 
decoding, on the other hand, Vole womienwwa th) any convolutional 
code, but it will not work well on channels where there is 
correlation between errors, i.e., burst Channels. = "ode une 
Viterbi decoding algorithm is a maximum likelihood decoding 
procedure, it is limited to codes of relatively short con- 
Srrarmmeeltengeth by the storage requirements. In SINCieG vee 
are no known classes of convolutional codes with decoding 
procedures comparable with the longer Bose-Chaudhuri- 


Hocquenghem block codes. 
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